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This paper presents two examples of the simultaneously orthogonal 
expansion of the sample functions of a pair of stationary Gaussian proc- 
esses. The pair of Gaussian processes are specified by zero means and co- 
variances exp ( — a | s — t | ), exp (— /3 | s — t \ ) in Example 1 and by 
1 — \ s — t\ /2T, exp (— | s — t | /T) in Example 2. The expansion takes 
the form of a trigonometric series where the coefficients are mutually in- 
dependent Gaussian variables for both processes, and the series converges, 
both with probability one for every t and in the stochastic mean uniformly 
in t, for both processes. This type of expansion is an extension of the Karhu- 
nen-La&ve expansion to the case of a pair of processes, and no concrete 
example has been given previously. 

The general theory of the orthogonal expansions is briefly reviewed in 
Section I, while concrete results for the two examples are tabulated in Sec- 
tion II with a brief outline of the method of derivation. The complete deriva- 
tion, which constitutes the principal part of this paper, is presented in full 
detail in A ppendices. 

I. GENERAL THEORY 

Orthogonal expansion of Gaussian processes has been used extensively 
for both theoretical investigation and application in communication en- 
gineering. In the case of a single process, the expansion is a modified ver- 
sion of the Karhunen-Loevc expansion. 1 ' 2 Specifically, if x(t), —T ^ 
t ^ T, is the sample function of a Gaussian process with zero mean and 
a continuous co variance R(s,t), —T^s,t^T, then x(t) can be ex- 
panded in terms of the (orthonormalized) eigenf unctions /t , k = 0, 1,2, 
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• • , of R as follows:* 

x(t) = E&(z)/*(0, a - e - I p l» 

i- 

&(*) = (*J*), a.e. [P],t 

where P is the Gaussian measure induced by the process with zero mean 
and the covariance R. 

This expansion has two desirable properties: (i) for every measurable 
set specified by the sample function x(t), there is an equivalent measura- 
ble set specified by the coefficients, {&}, and (») {&} are mutually in- 
dependent Gaussian variables with zero means and variances equal to 
the eigenvalues of R. Thus, many problems concerning the sample func- 
tion can often be reduced to equivalent problems concerning the coeffi- 
cients alone, and they in turn can be decomposed into a collection of 
effectively "one-dimensional problems". 

In the case of two Gaussian processes, the sample functions can be 
expanded relative to a single set of functions such that their coefficients 
are mutually independent with respect to the two finite dimensional dis- 
tributions.! Such "simultaneously orthogonal" expansions have often 
been used to prove the equivalence-singularity dichotomy of two Gaus- 
sian measures. 8 ' 4 ' 8 The particular expansion theorem used here is due to 
Pitcher. 8 It goes as follows: Let Pi and P 2 be the probability measures 
induced by two Gaussian processes with zero means and continuous, 
positive-definite covariances Ri(s,t) and R*(s,t), — T ^ s, t ^ 7\§ If 
R{*IfcR{* is densely defined and bounded on £ 2 and its extension to the 



* R denotes both the covariance and the integral operator generated by it, 
namely, 



(Rf)(t) = f R(s,l)f(s)ds, /e£ 2 , 

J—T 



where £ 2 is the space of square-integrable functions on [—T,T\. 

t Without loss of generality, the process under consideration is assumed to be 
separable and measurable. (f,g) denotes the usual scalar product of two elements 

/ and g in £ 2 • . ... 

t Instead of regarding "two Gaussian processes' as two one-parameter families 
of random variables, we consider a single one-parameter family of measurable 
functions x t , — T ^ I ^ T, with two probability measures Pi and Pi . 

§ We assume that P\ and P 2 are extended to (B and complete on ($> P , and (Bp, , 
where (B is the minimal <r-field with respect to which x t is measurable for every 
I e [-T T]. Since Ri(s,t) and fi 2 (s,<) are both continuous, we consider only the 
separable and measurable version of \x t , —T g t ^ T\ without loss of generality, 
where the separability is with respect to \{Pi + ^2) while the measurabdity is 
with respect to (Bj<j>,+iM X & and Q, is the Lebesgue field of the subsets of [-T,T\. 
Note that such a version is also separable with respect to both Pi and P 2 and meas- 
urable with respect to (B/>, X Q, and ($> P „ X &■ 
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whole of £ 2 has a set of eigenfunctions which spans £ 2 , then 

n 

x(t) = l.i.m. £ Vk (x)(RUic)(t), [Px X m, 1\ X 4 

n-»oo k=Q 

Vk (x) = i.i.m. u/erW, [P.,P 2 ], 

J-.00 

where <p k , k = 0, 1, 2, • • • , are the orthonormalized eigenfunctions of the 
extension of RC R2R1 , and n is the Lebesgue measure defined on the 
subsetsof [— T,T], and?*,- ,j = 0, 1, 2, • • ■ , area sequence of £ 2 -functions 
in the domain of R that converges strongly to <p k for each k, namely, 

tp ki e SD(flf*), lim || ?* - ^. ; - 1| = 0, A: = 0, 1, 2, • • • . 

,--oo 

As in the case of a single process, this expansion also has two desirable 
properties : 

(i) for every measurable* set A specified by x(t), there exists another 
measurable set A specified by { r) k \ such that 

Px(AAA') = = P 2 (A AA'),f 

(n) EiivkVi) = 8 kj , E-ilvkVj] = XAy, k,j = 0, 1, 2, • • • , 

where X* is the eigenvalue of the extension of Ri^RJii -1 corresponding 
to <p k . As seen from the definition and the property (ii), ri k , k = 0, 1, 2, 
• • • , are, with respect to both l\ and P 2 , mutually independent Gaussian 
variables with zero means, and their variances are all unity with respect 
to Pi and Xfc with respect to P 2 . 

Unfortunately, the above theorem is not a suitable method of actually 
obtaining the simultaneous expansion for a given pair of co variances 
Ri(s,t) and R 2 (s,l). As the result of defining the expansion coefficients 
tit and the expanding functions R\<p k in terms of <pt , k = 0, 1, • • • , one 
must first of all solve the homogeneous equation involving the extension 
of Pi -3 P 2 Pi . Yet, there is no standard method of solution available for 
this type of equation, since Ri~ J R->Ri~' is not, in general, a simple operator 
as Pi and P 2 are. This may partly account for the fact that no concrete 
example for the simultaneous expansion has been given previously. In 
the next section and Appendices, we give two examples to illustrate an 
indirect method of obtaining <p k first and then calculating -q k and PiVfc • 



* The mea8urability is with respect to (Bkpi+p=) • 

fA denotes symmetric difference, namely, A A A' = (A — A') U (A' — A). 
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II. EXAMPLES 

The two examples we consider here are stationary Gaussian proc- 
esses with zero means and the pair of covariances 

Riisj) = exp (-a | s - t J), P 2 (s,0 = exp (-0 | s - t\) 

in Example 1, and 

«!<*) - 1 - ^^ ' RsM = GXP (" l ~^) 

in Example 2. 

The method we employ to obtain the expansions may be outlined as 
follows: First, we prove that Rf*RaRf* is densely defined and bounded, 
by showing that RtRf* is bounded. Next, we consider solutions of the 
homogeneous equation 

Rml'k = ^/cRi^k • 

If ypk is a square-integrable solution with a real number X* , then Rxfa is 
seen to be an eigenfunction of Rr i R 2 Ri~ h . Thus, the function Ri<p k in the 
desired expansion is simply Ri\p k * Unfortunately, there are no such solu- 
tions in Example 1, and there are only half of what is needed in Example 
2. However, suppose we consider "formal solutions" of the homogeneous 
equation and expand them relative to the set of eigenfunctions of R\ , 
which forms an orthonormal basis of £ 2 • Let \f/ k j be the sum of the first 
j terms of such an expansion. Then, it turns out that the normalized 
version of {Bity*ili is the desired sequence [<p ki \ used for defining rj k . 
That is, we show that (i) the normalized version of [Rifaj)i forms a 
Cauchy sequence and its limit in the mean is an eigenfunction of the ex- 
tension of Rr'RiRi~ h with X fr as the corresponding eigenvalue for each 
k, (ii) the collection of all such limits forms an orthonormal basis of 
£ 2 , hence they are the only eigenf mictions of the extension. Thus, the 
desired expansion is obtained simply by calculating Ri<p k , k = 0, I, 2, 

Finally, that the expansion series in both examples converge both 
a.e. [Pi , P 2 ] for every t and in the mean [Pi , P 2 ] uniformly in I, is de- 
duced as follows: We first observe that the ^-functions of the series are 
uniformly bounded in i and t, and the sum of the variances of the coeffi- 
cients is finite with respect to both Pi and P 2 . Thus, by virtue of mutual 
independence of the coefficients, the partial sum of the series, denoted by 

* The expansion in terms of Rifa is suggested in Ref. 6 without the connection 
with RrlR-Jlr*. 
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x n (t), converges both a.e. [Pi , P 2 ] for every t and in the mean [Pi , P 2 ] 
uniformly in t to some Gaussian variable x(t), Ei[x(t)\ = = E 2 {x(t)}. 
Now, since x n (t) converges to x(t) in the mean [Pi X m, Pi X mL 
Ei{x n (s)x„(t)\ and E 2 {x n (s)x n (t)\ converge in the mean \p X lA to 
Ri(s,t) and R 2 (s,t) which are continuous. Hence, they converge uni- 
formly to Ri(s,t) and R 2 (s,t), respectively, which implies that 

E!{x(s)x(t)} = RtisJ) and # 2 {x(s)z(0} = # 2 (M)- 

That is, {£(0, — ?' ^ £ ^ !F) is a Gaussian process with zero mean and 
covariances Ri(s,t) and R 2 (s,t) corresponding to Pi and P 2 , respectively. 
Hence, x(t) = x(t), a.e. [Pi , P 2 ] for every t. Thus, it follows that x n (t) 
converges to x(t) both a.e. [Pi , P 2 ] for every t and in the mean [Pi , P 2 ] 
uniformly in t. 

The results are tabulated in the following summary. In both examples, 
the orthogonal expansions of the sample function take the form of 
trigonometric series, which asymptotically behave like harmonic series 
for large indices. The coefficients are mutually independent Gaussian 
variables with zero means, and their variances are explicitly given, 
together with the asymptotic values for large indices. In addition, we 
include for future reference the eigenvalues and the (orthonormalized) 
eigenfunctions of the extension of Pi~*P 2 Pi -i to the whole of £ 2 , though 
they are not of the primary interest here. 

III. SUMMARY 

3.1 Example 1 

R x {s,t) = exp (—a \ s — t\), R 2 (s,t) 

= exp (-(3\s - t\), a > (3 > 

00 

x(t) = 2 lvi(x) cos Bit + fc(x) sin dd], a.e. [P, , P 2 ], 

t=0 

where 0,'s and 0,'s are positive solutions of* 

(a + p)di tan OF = a/3 - B* t 

- (a + P)6i ctn d<T = a/3 - Q?, 

and 77, , 4}i , i = 0, 1, 2, • • • , are mutually independent Gaussian varia- 
bles with zero means and variances given by 



0,'s and 0,'s are indexed in the ascending order. 
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Ei[f,l\ = 2a/ (a 2 + 0, 2 )r(0,), Ex[Hi\ = 2a/ (a 2 + ti)r(6 t ), 

E 2 { Vl 2 \ = 2/3/03 2 + tfMfc), Et{1}?} = 2&/(tf + & 2 )t(&), 
where 

(a + 0)oqS 



r (0) = r + 



4 + (a 2 + /3 2 )0 2 + a 2 /3 2 



For large i, 



A-^ + gJj. 



Ex {*,'} 



Et ivi 2 } 



2aT 



' + JV 



2^r 

-thy;. 



_i _ _ _i 



. 7T 



*ltf|~£. 



#2 {*?/ 






The extension of i?i 3 ft 2 fti J has eigenvalues 



. _ jS a 2 + fc 2 
X2i "a^R?' 

and orthonormalized eigenfunctions 



A2i+1 — — 



/3 a 2 + 6 2 



a/3 2 + 0,- 2 ' 



<p2 



<(0 = 



2a 



« + 



<+.(«) = 



(fi 



where 



* + & 



r 2 , - 2-|5 n 

" 7~n cos 0<T l.i.m. 2] 7(o7 , fc) c OS acr/i 1 COS ot^ 



• 2 , A 2-H n 

a T sin d t T l.i.m. £ y(£j ,&) sin avjT sin a^, 

. t(0.) J »-• »-° 



y(a,6) = (1 +<r 2 )*/ 



?' + 



a(l + <r 2 )_ 



/ 2 2 a 2, i 
(a<r — e ), 



and try and a, are positive solutions of 

<Tj tan aeryT = 1, — frj ctn air/T = 1. 



* 0-,'s and Vs are indexed in the ascending order. 
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3.2 Example 2 

BiM = 1 - ^r^ , «.(**) = exp (- LlziA . 

x(t) = X) Mx) cos Bit + ft (as) sin $4), a.e. [Pi,PJ 

«=o 

where 0,'s are positive solutions of* 

BiT tan 0,7' = 1, 

and rjt , rji , i = 0, 1, 2, • • • , are mutually independent Gaussian varia- 
bles with zero means and variances given by 



*.{**} = «.{*■) = 2-q^ 



For large i, 



2, i ,. . ?. 2 



i t-ir i'tt* 



The extension of R\ R?R\ 3 has eigenvalues 

_ 2fl,- 2 ?' 2 

and orthonormalized eigenfunctions 



, 2 + fl.-V V' 
1 + 0, 2 7 T2 / 



H«(0 = 



<P2i-r\ 



<P2i(t) = ( 7' 7 * _. J COS 0,4 



r (-i)'0\+J)» .: 



n-°° j=i)0fl- — {J + 2) T ■* 
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APPENDIX A 

Example 1 

Ms,t) = ex V (-a\s-t\) - T < S}l <T, a > > 0. 

R 2 (s,t) - exp (-j8|s- *|), - ' " 

A.l Eigenvalues ami Eigenfunctions of Ri and Ri 

Let nk and /* , k = 0, 1, 2, • • • , be the eigenvalues and the corre- 
sponding orthonormalized eigenfunctions of Ri . Then, 

M2.- = n i 2\ > M2»+l = n , a 2 x > * = 0, 1, 2, •••, (1) 

a(l + ffi 2 ) a(l + or) 

fe(t) = cos ount / [T + — 2^~~) ' 

, ,,v • *, //m sin gaftgV 

/«+i(0 = sin o^ / I 2 ^-y- — I , 



(2) 



where o-, and £, are positive solutions of 

<n tan ao-.T =1, -a,- ctn aa/T = 1, (3) 

respectively, indexed in ascending order. 

Similarly, the eigenvalues and eigenfunctions of Rt. , denoted by Vk 
and g k , are given by 



Vu - 0(1 + «") ' " 2, ' +1 "/3(l+P. 2 )' 

sin ggg g* 

2/3* 

^ +1 (0 = sin W /(T-«^y, 



f/2i(0 = COS ap,£ / I T + 



(4) 



(5) 



where pi and p\ are positive solutions of 

Pi too. Pp/F = 1, -fc ctn. pfcT = 1. (6) 

A. 2 Boundedness of R£R{~ 

Since {/*} forms an orthonormal basis of £ 2 [— 5P,r], we only have to 
show that || RzRC'fk || is uniformly bounded relative to the index fc. 

* See Ref. 7, pp. 99-101. 
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Namely, we must show existence of a constant c, < c < oo , independ- 
ent of k such that 

II /e^r*/* II 2 = E-(A,0<) 2 < c. 

1 Hk 

Consider even fc's, and put A - = 2i, i = 0, 1, 2, • • • . Observe 

(/«,?,) = 0, /.-odd. (7) 

Hence, we shall consider only even /'s. Note 
f / cos aa it cos fipjt dt J 

</« , to)' =- - — . 9 rW — ■ ' T s . J - 0, 1, 2, 

sin 2atr,-7 1 \ / y sin 2/3p,T 



2ac, / \ 2/3p,- 

/ cos ao-.i cos flpjt dt 

J—T 



of tnn t a +„„ a T ^ cos aatT cos P Pj r . . 

= 2(qio-, tan acr.i — /3p,- tan ^i ; — — — — - — (8; 

eeof — prpf 

, O vcos ctffiT cos fip/r 

= 2{a - p) — —- — 

aW - p 2 pj 2 

where (3) and (6) are used for the last equality, and 

(1 + „?) COS 2 aa;T = af, (1 + p/) COS 2 Pj T = pf, (9) 

which also follow from (3) and ((i). Thus, 

4 2 (a- 0) 2 cos 2 Pj f , , 2 2 

"2.- /. \2 _ a a(ppj)a <Ti ,. ft v 

P2> y. , sin laOjL p'pj-{a z <TS - pFpf)* 

2aai 

where 

cos 2 6T 



aid) = 



T , sin ::'//■ 



20 

Also note that 

2 
a o- 



1 1 



+ 



+ -!-( J_ + _L_ Y 
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First, through direct calculation with the use of (5) and (8), 
/ cos cant g 2 j(t) dt = 4(a — /3) 2 cos 2 cunT / 2(T .2 _ 'm %y » 
and from the fact that [g k \ forms an orthonormal basis of £ 2 , 
2 / cos cunt gait) dt\ = J cos 2 cunt dt 

T sin 2a<nT 

+ 2affi " 

Thus, 

„ 4- (a - /3) 2 cos 2 /3/j/T ,. v fl/ 

H U sin 2 a <r,T \ («W - pV) 1 ~ cos' aa Q T ' 
\ 2a(r, / 

Secondly, it follows from (3) and (6) that 

sin 2a - i r f" 1 1 r 






(12) 



and 



l*f>(fi)\ W>(}iY, i = 1,2,.... (is) 



Thus, o(j8py) < 1/T. Hence, 



^ / sin 2aa t T \ «W/*V 

\ + 2a<n ) 



(14) 



4^(a-/3) 2 



< _^ l + 1 E - 

Thirdly, let fti(z) be a function of the complex variable z denned by 

z 

hl{z) = z tan zT - ' 

Then, /ii(z) satisfies the condition of a theorem on expansion in rational 
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functions,* and has poles ±0p,- and the residues a(0pj),j = 0, 1, 2, • • • . 
Hence, according to the theorem, 

E a(fipj) ( i— - + l -—) = fc(«r,) = -SSL- , (15) 

,=o \ao-i + (3pj aoi — ppj/ a — 

where (3) is used for the last equality. Thus, 



4 2 (a - /3) 2 cos 2 ftoyT 



,- ia - pr6W »- W i a(/3p .) / i 1 \ 

£j ( T , sin 2a(r,r \ 2a 3 tr.- 3 \a<r, + jSpy «* - fa) 
V 2a(Ti / 



(16) 



20(a - /3) 



a u (To 



T 



where (12) is also used. 

Therefore, upon combination of (11), (14), and (16), together with 
(7), we conclude that for even k's ^i (vi/nk) (/* , Qif is bounded by the 
sum of the right-hand sides of (11), (14), and (16), which is obviously 
independent of k. 

For odd k's, we can arrive at the same conclusion by following the 
similar steps. 

A.3 Formal Solutions of R 2 ip = X/?^ 

The formal solutions of the homogeneous integral equation 

/ exp (— fi\s — t \)\f/k(s) ds = \ k I exp (— a\ 8 — t |)^*(s) ds 



-T 

are 



j8 a + 6i . a + 0? 



*« ■ - og ; a \ , \,.-+i = - , 2 I A ' 2 , i = 0,1,2, ••-, (17) 



a & + ft 2 ' """ a s + 0/ 

fe(f) = cos 0,7 4- ^-M-' [i(| - T) + «« 4- DJ, 
a 4- (3 

hm(t) = sin ^ 4- ^^ [«(« - D - 6(t + Dl, 

where 0, and 0, are positive solutions of 

(a 4-0)0, tan 0/7/ = a/3 - 0,'\ 

- (a 4- 0)0, ctn 0\-T = aj8 - 0, 2 , 
* See Ref. 8, p. 134. 



(18) 



(19) 
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respectively, and they are indexed in ascending order. Namely, if 0, and 
di,i = 0, 1,2, ■•■ , are solutions of (19), then the following equalities 
hold for every i: 

I exp ( — p | 5 — t\) cos diS ds 

J—T 

+ ^iM! {exp [-fi(T -t)] + exp [-0(T + 01} 

a + /3 

■ «_±A' ["f exp (-a I 8 - f I) cos fcs rfs 

cos^T {exp t _ a( y _ 0] + exp { _ a{r + 0]) 1 f 

(») 
/ exp ( — /3 | s - t\) s'm disds 

J—T 

+ !EM {exp [-0(T - 01 - exp [-/3(T + 01) 
a + 

= 2 « ' + d f [ T exp (-a | s - < |) sin 6 iS ds 

+ 5E**? {exp [-«(r - 01 - exp [-a(T + 0]}] ■ 
a + P 

The above assertion can be verified through direct calculation. 
A.4 Eigenvalues and. Eigenfunctions of Ri 5 /£ 2 fti 

A.4.1 [Rifai] i form Cauchy sequences 

Let fat , k, I — 0, 1, 2, ■ • • , be the Zth partial sum of the series ob- 
tained by formally expanding fa of (18) relative to [/*} of (2), the eigen- 
functions of Ri . Namely, for i = 0, 1, 2, • • • . 

fai,2n(t) = ^2i,2n+l(0, 

= zr/ ,T cos0 lS / 2j ( s )rf s + 2^iZ:/ 2> (r)]/ 2J a), , . 

,=o _J-r « + ^ J (21) 

fai+\,2n+l(t) = ^2»+l,2n+2(0 

6iSf2j+i(s) ds 



Z / sin 0, 



+ 2 5^/^(r)l/ W K<0. 

a + j8 J 
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Then, (22iV*z}i forms :i Cauchy sequence for every k. 
Proof: It suffices to show that for every k 

lim \\Ri\I/ki II 2 < oo. 



From (1) and (2) and through the use of (19), 

|| Rlfai,2n II 2 = S / COS OiSfaM ds 

1=0 [_ J —T 



T 2 

J a(l + a/ 



o I , I + cr, 2 ) 

-———cos op £, o(flwy) v "T '/ . 

(a -+- p; z ;=o (0,- 2 - aV/)- 



Note also that 
2a 2 (l + «r/) 



= 2 



a + 6? 



I C_L_ + _J_^ 

0, \0, + 2cr y T t - a«r y y 



(0< 2 - aV) 2 (*i 2 - «V) 2 

Next, with the aid of (2), (3), and (19), we find 

Also observe that 

Y.\ f cos ditfuit) dt]~ = f cos 2 0,* <ft = T + sin2g ' T . 

j=o J-r J J— r 20,- 



Thus, 

4a 

(« + PY 



cos 2 0,7' ^2 o(aiTj 



2a 



;=n 



a(q 2 + 0, 2 ) 



/„ sin 20,7' \ 



Next, following the procedure for obtaining (15), 
4a 



(a + /3) 2 



cos 2 ft T f ^ f — 1— + 1 ) 



4a cos 2 0,7' 
" a + J3 a 2 + 0,- 2 ' 

where (19) is also used. Hence, 

am II RU«, \\> = *^ (r + *£* + ^4^) - «M6> , 

z-°° a 2 + 0,- \ 20, a + /3 / a 2 + 0i 2 
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where 

, R \ T , (a + P)aP (22) 

TKUJ -T p + (a2 + ^^2 + a2/3 2 » 

and (19) is used for the second equality. 
By following the same steps, we obtain 

.. | |p ». |,2 2ttr(6,-) 

Thus, the assertion is proved. 
A. 4. 2 Orthornormality of {ip k } 
Define p* M , k, m = 0, 1, 2, ■ • • , by 

p2»,2n = P2i,2»+1 = Mini || Rlfai.l || J ' R\fai,2n , 
pM+l,2»+l = <p2m,2»+2 = Aim || Rifci+i.l \\ j Rl ^Si+l.Sn+l • 

Define ipk by 

tpti = l.i.m. ^2,,2» , f-u+i = lim. ^psi+i.ta+i • (24) 

Then, {^> fr ) is a sequence of orthononnal functions. 

Proof: Normality is obvious. To prove orthogonality, let us first write 
<p k explicitly. 

" [2a 2 (l + <r/)]* COS aojT 

n-oo 2=0 /m , Sin Jaffj/ \, l ! . 2n 



(23) 



^ 7 (25) 

- ,_ [2 a 2 (l + £/)]* sin a*// 7 
<P2i+i(t) -- lim. bi g 7 ~^v77 - sinaiaA 






where 



. f2(a 2 + e, 2 )f cos 0,-T ; [^L+lill sin *< r f 9(0 

First, note 

(*m , <P2m+i) = 0, i, m = 0, 1, 2, • • • . 
Secondly, 

t N 1.1. V f 2a 2 (l + a/) 
{<P2i,<p2m) = Oib m £_, a{aarj) 2„.2\/ fl i _ 



£»w w _ aV ) (jl«-«V) 
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and 

2a'(l+<r/) 

(0, 2 - <*V)(0m 2 - A/) On? ~ 



- 6? L Oi \Bi + aa j ^ 6i - aajj 



a + e m V i , I 



Again, following the same procedure for obtaining (1")), 
/ v bib m (a + Of dt 



?,- tan ^r - a 

- ^ ± *■' - ) «, 

6 m d m tan 6 m T - a) 

where (19) is used for the second equality. 
By following the same steps, we also obtain 

A.4.3 \<pk\ forms an orthonormal basis of £ 2 

Since {(p k ) is a sequence of orthonormal functions and [/jj is an ortho- 
normal basis of £ 2 , it suffices to show that for every Z = 0, 1, 2, • • • , 

First, note that (/* ,<p k ) vanishes unless / and k have the same parity. 
Secondly, from (2) and (25), 



^ cos 2 ^ 4aW(q 2 + fl/) 
£j (a + 0)r(*,-) (aW - */)» ' 

and also note 

4aV(q' + fl/) , M ,,[ 1 , 1 "| 

(aW ~ 0/)* ~ a[ ^ a>) Liar; + 9,)* + («r f - 0y) 2 J 

+ a-(i-^)/ i_ + _i_y 

air,- \octTi + 0; tt<7, — 6j/ 

Now, consider a function of the complex variable defined by 

z 



h 2 (z) = 



[a + I3)z tan zT - ap + z 2 
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hi(z) satisfies the condition of the previously quoted theorem and has 
poles ±0/ and the residues 



cos' B/T 



{a + 0)r($i) 
Also, 



, 3 = 0, h 2, 



Thus, according to the theorem, 

q 2 (l - **) A cos 2 frf / 1 1 \ 

a<n h (« + 0)f(0,O \«r< + 0, a«r f - dj 

= WaO = — — , 

aff,- 1 + or 

where (3) is used for the second equality. Also, through the use of a 
modified version of the theorem, 



a 2 (l + <x 



2 - cos 2 OjT I" 1 , 1 1 

* ' pi {a + P)t(6j) licun + dj) 2 T (acr,- - 0,) 2 J 

= -« 2 (1 + *f) i hM | M , - (« + U) 

dz 

/ sin 2a < r > T \ _ 1 - a/ 

* \ ^ 2a<ri / 1 + c? ' 

Hence, upon combination of these two results, 

^ cos 2 9jT 4aW(a + tf) _ / , fl) fy , sinWT\ 
& (a + 0) T (»i) («W - 0/) 2 V aanr* / ' 

* The modified version: 

Let/(z) be the function satisfying the condition of the theorem (Ref. 8, p. 134), 
having poles a„ and their residues b n ■ Then, 

n (a„ — a;) 2 oz 

This is proved by noting that 

— . / ~r- ^ dz = — f(z) \.-x + 2- ', r, » 

2wi J Cm (z - xY dz J „ (a n - x) 2 

and the left-hand side vanishes as m -* », where C m is the contour defined in 
Ref. 8. 
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Thus, 

00 

EC/k.w/) 1 = 1. * = 0,1,2,.-. 

;=0 

By following similar steps, we obtain 

00 

E (/«<+! » V2>+l) 2 =1, « = 0, 1, 2, • • • , 



1-0 



and the assertion is proved. 

A.4.4 Closed form-expressions of Riip k 



* W<) -[ (rf + *)T(fJ ~» 

» = 0, 1, 2, • ■ ■ . (27) 



Rl<P2i+l(t) — , , -. - . 

L(a 2 + 0i 2 )r(ei)_ 

Proof: From (25) and (1), 



sin Bit, 



„-.oo c/, ,=0 \t7, -f- a(Tj oi — aa j 

-*iW«(0 = lim ^ it 6,(1) (^-^r + T-i-x") , 

n-°° 0i >=n \0, + ««■> 0, — ac7-;/ 

where 6, and i», are given by (20) and 

, x cos a 07 7' eos aoyJ . , , sin a^T sin aajt 

° A ' == T + (sin 2atrjT/2aaj) ' ° A ' ~ T - (sin 2a^T/2aj) ' 

In order to sum the series, consider 

2 cos zt 



fo(z) = 



z sin zT — a cos z!T ' 



Observe that h 3 (z) satisfies the condition of the previously quoted the- 
orem, and has poles ±aaj and the residues Cj(l), j = 0, 1, 2, • • ■ .* 
Thus, with the use of the theorem, 

Bi {a- + 0/) cos &il 



* The residues of A 3 (2) are shown to be c,-(0 through direct calculation with 
the use of (3). 
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where (19) is used for the second equality. Similarly, 

-«.W0 -- <„, + ,,) ^ fcr --* 

Then, substitution of (20) into the above gives (27). 

A.4.5 \k and <pk are eigenvalues a?id. eigenfunctions of Ri R 2 Ri 

\ k and tp k , h = 0, 1, 2, • • • , are the eigenvalues and the corresponding 

orthonormalized eigenfunctions of the extension of Rf R2R1 to the 

whole of £2 • 

Proof: It suffices to show that for every k 

X*22iV* = l.i.m. A',/1'1 ■_-..■., . 

m-*» 

where p* m , TO - 0, 1, 2, • ■ ■ , are defined by (23), namely, <p km is the 
rath partial sum of the series obtained by expanding ?* relative to 

1/4. 

Through direct calculation, 



/ exp ( — (8 I 8 - t\) cos OiSds 

J-T 



+ £21^ {exp [-/3(T - 01 + exp [-B(T + 01} = p^r-p™ 6 < L 
a + p p -r 17, 

Thus, from (17) and (27), 

+ C0S , giT {exp [-0(7 - 01 + exp [-/3(T + 01}1 . 
On the other hand, from (23) and (21), 

(fiiRrWi»)(t) - (^2KrW.2»+i)(0 

= h + ^ s uwwxo r/ r cos M/«(t) ^ 

2a COS 0,i ,=0 L**-' 

+ 2 co^T /!j(r) l 

a + P J 

But, since 

I exp (— B I s — 1 1) cos 0,-s rfs = l.i.m. 2 (fitfy)(f) / cos M/w(«) <**, 

J-r n-00 3=0 J -r 

we only have to show 
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exp [-0(T - t)] + exp [-fi(T + t)] f 2 lim E/«i(r)(«i /«)(*), 

n-*°o 3=0 



i.e., 



ft(r^) +i? 2 (-r,o = urn. E [/,(d +/i(-j , )](b 1 /i)(0. 






But this is certainly implied by 



R%(8JL) = E (h,R*fi)f k (s)fi(t), -T ^ s,t g T, (28) 

k,l=(\ 



where 



R2 2 (s,t) = / R 2 (s,u)R 2 (u,t) du. 



To prove (28), we first note that the series on the right converges to 
RtiSjt) in the mean. In addition, 

l/*(0 I < T~\ 
as seen from (2) and (12). Hence, it suffices to show that 

00 

E |(/*,«iVi)| < °°, 

A-,Z=0 

which is implied, through the Schwarz inequality, by 

00 

E II B^ll 1 < «>. 

Hence, we have shown that 

MiRi<P2i = lim R2R1 (p2i, m , i = 0, 1, 2, ■ ■ ■ . 

m-*« 

Through the same argument, (28) implies 

A2i+l/?lV2i'+l = ii m RiRl <P2i+l,m • 



APPENDIX B 

Example 2 



Ri(s,t) = 1 - ^7^ » 

/ [ s — f |\ 

R 2 (s,t) = exp ( - J — y~ ) ' 



-T ^ s,t ^ T. 
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B.l Eigenvalues and Eigenf unctions of Ri and Ri 

The eigenvalues and the ortho normalized eigenf unctions of R\ are 

1 T 

(• + *)* 



M2» = TiTTi ' *** +1 = H j- l^2^2 ' * = 0, 1, 2, • • • , (29) 



jin (*' +j)| 



sin 

* M = ( T , C rinWy ' /2 ' +l(0 = ' T*"'" - ■ (30) 
V + 2B t ) 

where 6i , i = 0, 1,2, ••• , are positive solutions of 

fl.rtan 0,7' =1, (31) 

indexed in ascending order. Similarly, the eigenvalues and eigenfunctions 
of R 2 are 

2T 2T 



V2i ~ i + eft* ' " 2,+1 ~ l + d?T 2 ' 

sin dd 



!32) 



_ sin 20.TY ' (33) 



02,(0 = /«(0i 02,+l(O = 

f r _sn 

20; 

where 5,- , i = 0, 1, 2, ■ • • , are positive solutions of 

-diT ctn diT = 1. (34) 

B.2 Boundedness of R2R1 

From (29), (32), and (33), 

9fl 2 7 l2 

II Rter% ii 2 = j ^ e , T2 < 2, » = 0, 1, 2, • • . . 

Since 

(W , fly) = 0, J = 0, 1, 2, • • • , 
we have, through (29), (30), (32), and (33), 
II P *p -h Hi _ V 2 ^ 2 ' 2 4IT cos 2 0/7' (t + |)V 

|| -«2 «1 J2.+1 || — Z-i \ - 2,7,2 : ^T^; fn 2„,2 / • , , s2 2i2 » 

;=o i + e y r r _ sm 2e y r [0 y 2' — (* + 1) * ] 

2dj 
and also note 
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(i + j)V _ e 2 T 2 



\e 2 T 2 - (i + |)V] 2 [e 2 T 2 - (i + |)V] 2 

(35) 



Now 

A 4T cos 2 6jT d 2 T 2 A 2 

;=o T _ sin 2J/T [0>T 2 - (1 + i)VT /-o (36) 

2(9, 

A 2djT 2 T cos 2 gjT 1 

/=o l + d/r" y sin 2fl,T d/r 1 - (t + J)V 

< y ^'y' r cos 2 g/T 

= /-o(l + 6 2 T 2 ) 2 T sin 2fl,T °°' 

20y 

where the first inequality follows from the Schwarz inequality and (30) 
while the second follows from (34).* Hence, || flaffo /k+i || 2 is also 
bounded by a constant independent of i. 

Thus, by using the argument in A.2, we conclude that R2R1 is 
bounded. 

B.3 Formal Solutions of Ri^p = XRo^P 
Unlike Example 1, the even solutions of 

C exp (" ^T~^) Ms) ds = Xk C i 1 ~ ll W^) Ms) ds (37) 

are bonafide functions while the odd remain formal. They are 

2(?T 2 

1 + err 2 ' 

iMO = cos Bit, 



~Kli — Xof+l — q ; „ omv j (38) 



(39) 
foi+i(t) = sin Bit + T sin diT[S(t - T) - 5(t + T)]. 



* It follows from (34) that 



r _riuafcr / 1 \ 

28; \ 1 + h*T*J 



which corresponds to (12). 
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Again, the precise meaning of the odd solutions is that if 0* , i = 0, 1,2, 
• • • , are positive solutions of (31 ) then 



L^i- 1 - 1 -^)^ 6 * 



• exp 



s ds + T sin t T 

T - t s 



T 



— exp 



T + * 
T 



(40) 



26 i T 



f M _ If - I J sin 6iS ds + i sin B t T 



1 + 0i 2 T 2 

for every i. Again, the above assertions can be verified through direct 
calculation. 

B.4 Eigenvalues and Eigenfunctions of Ri~'R,2Ri~' 

B.4.1 [Rifai+ij] i form Cauchy sequences 
Define, for each i = 0, 1, 2, ■ ■ ■ , 

fci+1.2n+l(t) = ^2»+1.2n+2W 






/ sin disf-2j+i(s) ds ,^. 

+ 2TsmQ i Tf» +l (T)]f 2j+l (t). 

Then, [i2i^*+i,i}i forms a Cauchy sequence for every i. 

Proof: From (29) and (30) and through the use of (31) and (35) 

|| JRity 2 i+i.8n+i II 2 = £ / sin diSfe+iis) ds 

3=0 \_J-T 

1 T 
+ 2T sin 0& fy+i(T) 7 :y— 

V0* 



. cosfy-T A / 

= 4 -zrr--£f r 



0,- 2 T 2 



J=0 



[^-(r + j)VJ-^-(y + J)Vj- 



Now 



Er 

3=0 



40 t 2 T 3 cos^T 



ftT* - 



H)-'J 



J— T 



sin 20,-T 



r Bbw*-r-— ^j- (42) 



* Note there is no need for considering such sequences for the even solutions 
ipzi's, since they are already ^-functions. 
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In order to sum the second term, observe that the function of complex 
variable tan z satisfies the condition of the theorem repeatedly used, 
and has poles (j + |)t, j = 0, ±1, ±2, • • • , and the residues —1. 
Hence, using the theorem, 



1 



tan 6jT 



(43) 



Thus, combining the two results, 

Hm || ftWw IP = e jf (t + S ^) • (44) 

Hence, through the use of the argument in A.4.1, the assertion is proved. 

B.4.2 Orthonormality of [<pk] 
Define <p k , k = 0, 1, 2, • • • , by 

<ph = fa , <P2i+i = lim <p2i+i,i , (45) 

l-*oo 

where i = 0, 1, 2, ■ • • , and 

P2»+m(0 = Aim || Rifci+i.t \\\ Rifai+i.t . 

Then, {<p k \ is a sequence of orthonormal functions. 

Proof: Nonuality is self-evident. Note, from (30) and (41), 

(<f>2i , <P2m) — Si m , (<p2, , <p2m+l) =0, Wl = 0, 1, 2, • ■ • , 

and 

(<p 2i+ i,<P2 m+ i) = 47y 2 ,-(T)/ 2m (T) 



X 



2/m(T)/ b »(T) ^ 



'»» — "i J=0 



ff<r + (i + ^)T 



+ 



fc*-(j+§- W+(i+l)r 



ft-r — |i -+- 2 K 
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Thus, from (43) and (31), 

( \ or (wt m 6iT tan BiT ~ dmT tan dmT - n 

"m "i 

B.4.3 {ipk} forms an orthonormal basis of £ 2 
First, note from (30) and (45), 

Z (/« , v*) 2 = £ (/« ,/2i) 2 - 1, *" - 0, 1, 2, • • • . 

k=0 ;'=0 

Next, 

00 00 

Zl (fa + i,<Pk) = 2J (/2V+1 j ^2i+i) 

<t=0 j=0 

/. , lY 1 

" 4T cos^/T \ 2/ r 






= 1. 

Thus, using the argument in A.4.3, the assertion is proved. 

B.4.4 Closed form-expressions of Ri<pk 

(12iW(0 = di cos 0,«, CBiWuKO = di sin 0,«, (46) 
where 

1 / 1 x_i 



,t \ 1 + wry * 

Proof: The even part of (46) follows immediately from the even parts 
of (45) and (29). Now, from the odd parts of (45) and (29),* 



— (Ri<P2i+i) (t) = 1-i.m. X) 



„ 2(-l) i tW<T cos fcT sin U 4- ij J * 
l.i.m. 72 7 rr^ • 



/ 1\2 

„-»oo ;=0 - ~.™ / . . J- \ 



^-(i+2) ^ 



* Note, from (34) that 



^ 25,- \ 1 + ^ry 
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In order to sum the series, observe that a function of complex variable 
sin z(t/T) /cos z satisfies the condition of the theorem repeatedly used, 
and has poles (j + %)ir, j = 0, ±1, ±2, • • • , and the residues 

-(-l)'rin U + h)(T/T)t. 

Thus, according to the theorem, 



£ 

j=0 



■ ' ' "U + iut* 



sin Bit 



OiT cos OiT ' 



e>T* - lj + ^ 1 7t 2 

Hence, substitution of the above yields the odd part of (46). 

B.4.5 \k and ipk are eigenvalues and eigenfunctions of R{~*RiR{' t 

The assertion of A.4.5 holds. 

Proof: That X 2 , and <pn , i = 0, 1, 2, ■ • • , are eigenvalues and eigenfunc- 
tions of the extension of R^'R^R^ is easily seen from (29), (32), (33), 
(38), and (45).* 
For the odd part, i.e., X 2 ,-+i and «p 2 .+i , we need to show that 



Xo.+iffiVii+i = 1-i.m. RoRi V2f+i,m . 



(47) 



Through direct calculation, 

s - t 



L exp ( 



T 

+ T sin t T 



sin OiS ds 



T 



T - t\ ( T + t 

exp I — — ^ — ) — exp [ — 



T 



)] 



2T 



1 + 0?T* 



sin Bit. 



Hence, from (37) and (46), 






exp - 



+ T sin OiT 



exp - 



\s - t 
T 

T - t 



sin BiS ds 



T 



exp 



T + « 
T 



)]]■ 



On the other hand, from (45) and (41), 



* Note ipn is an eigenfunction of R{~iRtRi ~» itself, without extension to the 
whole of £ 2 ■ 
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(R2R1 V'2»+1.2n+l)(0 = (R2R1 V2i+l,2n+2)(0 

= did?T 2 £ (R-zf2j+i)(t) f sin disfzj+iis) ds 

1=0 \_J-T 



+ 2Tsmd i Tf 2j+1 (T)~}. 
But, since 

exp ( — ■! — = — ' ) sin 0,s ds = l.i.m. £ (Rriv+i) (0 

• / sin 0,s/ 2 y+i(s) ds, 
we only have to show 
exp (- ?^) - exp (- ^±- f ) = 2 lim Z/ 2 ;+i(r)(fl 2 / 2j+1 )(0, 

which is implied by (28). 

Then, by following the argument after (28), (47) is proved.* 

The second assertion of A.4.5 is valid in this case also, since {<pk} of 
this example forms an ortho normal basis. 
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